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PREFACE 



Educational development is an important aspect of national growth. 
Careful planning of this development is more likely to result in institu- 
tions responsive to societal as well as individual needs. Localization 
of staff for such institutions will take place more smoothly and rapidly 
when the number and types of training positions are selected during 
planning. From a financial point of view, advance planning makes known 
to all parties the full development costs of an educational project, so 
that its relative usefulness can be determined before project inception on 
an accurate cost effective comparison basis. 

Consultant assistance for the present plan was made possible by the 
United States Agency for International Development, under Contract 
AID/afr-668 with the American Institutes for Research. It has been a re- 
warding professional experience for both of us to assist in planning the 
development of the University of Botswana, Lesotho and Swaziland 
Schools Examinations Council. We would like to express our apprecia- 
tion to the many individuals, in the United Kingdom as well as the BLS 
countries, who freely contributed their time and expertise to the devel- 
opment of this plan. 



VIC 

CWS, Ir. 
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THE UNIVERSITY OF BOTSWANA, LESOTHO AND SWAZILAND SCHOOLS 
EXAMINATIONS COUNCIL DEVELOPMENT PLAN (1976-1985) 

CHAPTER 1 
INTRODUCTION 

The University of Botswana, Lesotho and Swaziland Schools Examinations 
Council (UBLS/SEC) is preparing to expand its external examination and certi- 
fication responsibilities, as well as its role in primary and secondary school 
curriculum development within its member countries. This plan addresses the 
educational measurement aspects of the expansion, as well as its economic 
feasibility. It also estimates the technical advisory assistance, capital re- 
quirements, and local staff training required for the Council to become an 
educationally effective and economically viable regional Institution by 1985. 
14 WORKING PARTY 

The governing body of the Council has established a Working Party which 
has prepared the present development plan as well as a second document dealing 
with administrative details and policy Issues related to the Council's growth. 
Represented on the Working Party, which has met several times during the past 
year, are the three concerned Ministries of Education, UBLS, the Council 
Staff, the Regional Testing Centre, and the American Institutes for Research 
(AIR) . 

1 . 2 CONSULTANT ASSISTANCE 

All planning has had the benefit of consultant assistance. In 1973, for 
example, the Centre for Educational Development Overseas (CEDO) provided 
consultant services of J. Deakln, former Registrar of the West African Exam- 
inations Council. Deakln prepared a report on "The Feasibility of Establishing 
a Regional School Certificate to Replace the Cambridge Overseas School 
Certificate Examination. " T.P. Kellthy prepared a report In 1975 on continuous 
assessment, under sponsorship of the British Council (^'Interim Report on the 
Introduction of Internal Assessment In the U.B.L.S. S.E.C. Junior Certificate 
Examination. "). This present report was prepared with the consultant assistance 
of V.J. Cleutat and C,W. Snyder of the American Institutes for Research In 
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cooperation with the Working Party. V.J. Cieutat has previously served as 
Director of the Test Development and Research Office (TEDRO) of the West 
African Examinations Council, and C.W. Snyder established and was appointed 
as Head of the Swaziland National Office of the Regional Testing Centre. 
Financial support for the services <>f Cieutat and Snyder was provided by the 
United States Agency for International Development. 

1.3 CONSULTATIVE MEETINGS 

Members of the Working Party, singly or as a group, consulted with various 
institutions concerned with overseas examinations development, administration, 
analysis, and interpretation. Meetings were also held with funding agencies 
to determine interest in supporting the development plan. Organizations con- 
tacted included the following: the U.iiversity of Cambridge Local Examinations 
Syndicate, the West African Examinations Council, the Regional Testing Centre, 
the Commonwealth Fund for Technical Assistance, the British Council, the 
Overseas Development Ministry, and the United States Agency for International 
Development. 

1.4 REVIEW SCHEDULE 

A preliminary version of this report was reviewed by the Council's Standing 
Committee on August 19, 1975. Committee membership included representation 
from the Ministries of Education of the Council member countries and UBLS. 
On the basis of this review this report was revised by the consultants for sub- 
mission to a full Council Meeting on September 23, 1975. The report, with 
the incorporation of any changes recommended by the Council, is to be sub- 
mitted to external donors for funding of those portions of the plan calling for 
such assistance. Those aspects of the plan not requiring external assistance 
will be implemented with Council supoort beginning in 1976. 



CHAPTER 2 
BACKGROUND 

In spite of the controversy associated with the merits and shortcomings 
of examinations, they without doubt constitute a powerful component of educational 
systems both in modem and developing societies. They are related to progress 
and certification in educational systems, entry qualifications for many positions 
in the public "and private sectors, and upward progress on many occupational 
ladders. Although external examinations are utilized essentially to assess 
student progress, as well as eligibility for further education, these examina- 
tions have a profound effect on what occurs in classrooms. It is thus virtually 
impossible to successfully achieve any educational reform, where external 
examinations are an integral part of the educational system, without having 
such reform closely coordinated with the examining system. 
2.1 NEED FOR CHANGE 

Curriculum content and related certifying examinations in the BLS countries, 
as in most Commonwealth nations, have historically been strongly influenced by 
the British educational system. This has been the case at primary, secondary, 
and tertiary levels, although most pronounced and formalized at the secondary. 
Over the past two decades there has been a trend in developing countries away 
from full British influence over secondary certification examinations, and to- 
ward partial or complete local control of curriculum content and the setting, 
administration, and marking of examinations. The most successful of this 
movement toward local control of education has been the West African Exam- 
inations Council which, in its twenty-three year history, has assumed complete 
responsibility for all O-Level and most A-Level examinations In Nigeria, Ghana, 
Sierra Leone, and The Gambia. Similar trends are currently underway in the 
Caribbean, Malaysia, India, East Africa, Tanzania, Malawi, and, of course, 
in the BLS countries as covered within the present plan. 

Current conditions in the BLS countries favor a change in their curriculum 
development and educational certification systems. At the Junior Certificate 
(I.e.) level, the examination given at the end of the third year of secondary 
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school, procedures for determining curriculum content on a local basis have 
not been as effective as they should have been because of limited funds and 
lack of adequate Council staff. This plan recommends improvement of the 
I.e. as a high priority early development target. At the secondary school 
^ completion examination level, the Cambridge Overseas School Certificate 
(C.O.S.C.) has been only as responsive to local educational needs as might 
be expected from an examining staff based in Great Britain, regardless of 
their competence and experience. There is strong support for local control 
of examinations in the BLS countries, evident among government officials. 
Headmasters, teachers, and the community at lai-ge. 

This development plan addresses technical as well as financial aspects 
of a regional examinations council, and suggests administrative n.-chinery 
for curriculum change in addition to that for examinations. Any local examining 
body which does not facilitate procedures for curriculum change risks transmitting 
some of the unresponsiveness of Commonwealth certiiication bodies to its own 
local situation. Indeed, such criticism has been leveled at the Caribbean 
Examinations Council in a recent issue of the London Times' Educational 
Supplement. Awareness of this possible pitfall, and deliberate planning to 
avoid it through a curriculum-improvement oriented administrative structure, 
will circumvent such problems with the UBLS/SEC and assure that it becomes 
a dynamic certification body constructively contributing to responsible cuiriculum 
evolution within its member countries . 
2.2 COMMONWEALTH EXAMINATIONS SYSTEMS 

Secondary examining in Great Britain has a long history, has undergone 
significant improvements in the past two decades, has influenced educational 
examining in many countries throughout the world, and tends to be somewhat 
confusing to those not familiar v/ith its origins, purposes, and organization. 
Secondary school examinations in Great Britain are presently administered by 
twenty-two approved examining boards. Each develops its own syllabusses, 
sets its own examinations and standards, and awards its own certificates of 
achievement. Prior to 1950 the most important examination administered by 
the then existing boards was the School Certificate (S.C.). Award of a School 



Certificate signified that thd holder had attended an ^'approved" school for a 
specified number of years and had attained minimum scores on a group of 
exaniinations , allowing some, but not complete, choice of subjects. The 
year 1950 saw a change toward a more flexible examination, the General 
Certificate of Education (G.CEj. The G.C.E. allowed students to earn 
certification of achievement in individual subjects, rather than a group of 
subjects, and without the restriction of having to attend an ''approved*' school. 
The G.C.E. examinations are now administered by eight approved examining 
boards . 

Both the S.C. and G.C.E. examinations were historically designed as 
selection procedures for university entrance. They thus tended to be academi- 
cally oriented rather than tailored for certification related to non-academic 
post-secondary pursuits. As a reaction to this a new secondary examination 
was established in 1960, the Certificate of Secondary Education (C.S.E.). 
The critical change was the design of the C.S.E. to accomodate a wider range 
of student ability and the provision for teacher participation in examinations. 
Three examining Modes are available for schools participating in the C.S.E. 
In Mode 1 the syllabusses are set and examinations administered essentially 
as for the G.C.E. For Mode 2, however, schools determine their own syllabusses, 
with examinations set and marked by an external board. And with Mode 3 full 
control is with the schools, including the determination of syllabus content and 
the setting and marking of examinations. Mode 3, in effect, is practically 
identical to the secondary certification system used in the United States, ex- 
cept that certificates of achievement are awarded by subjects rather than on the 
basis of having completed a somewhat variable four-year course of study. 
2 . 3 THE CAMBRIDGE SYNDICATE 

There are only three British boards whicn administer overseas examinations: 
The University of Cambridge Local Examinations Syndicate, the University of 
London University and School Examinations Council, and the Associated 
Examining Board for the General Certificate of Education (A.E.B.), The Cam- 
bridge Syndicate is of most relevance to the UBLS/SEC, as it is the C. O. S . C . 
which is taken by all school candidates in the BLS countries. (The London 
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G,C,E, is taken by a small number of private candidates •) The Cambridge 
examination given in the BLS countries is the Joint Examination for the School 
Certificate and General Certificate of Education, and is taken both by school 
candidates and private candidates. 

The Cambridge Syndicate has over a century of experience in overseas 
examinations, beginning with testing the children of British clergy in Trinidad. 
Cambridge is by far the largest of the British examining bodies and annually 
assesses about one-half million candidates, approximately two-thirds of 
which are resident overseas. The Syndicate functions administratively as a 
department of the University of Cambridge, and income from fees is used only 
to cover costs. It is a non-profit ustitution. 

The policy of the Syndicate with respect to handing over responsibility 
for examinations to local examining authorities is generally favorable, as 
clarified in recent meetings at Cambridge between Working Party members and 
the Secretary of the Syndicate, F. Wild, and A.V. Hardy and G.J. Overbeke of 
his staff. 

2.4 UBLS/SEC DEVELOPMENT 

The development plan has a high likelihood of success because of several 
factors. In addition to being carefully planned for a ten-year period, both with 
respect to technical and financial aspects, the Council is benefitting from the 
experience of similar efforts toward local control of curriculum and examining 
in other developing countries. Further, the fact that the plan is based on the 
expansion of an existing regional educational institution circumvents the early 
problems of establishing a formal organization, public recognition, and public 
acceptance. 

Prior to 1961 secondary school candidates in the BLS countries, then the 
High Commission Territories of Bechuanaland, Basutoland, and Swaziland, sat 
for the J.C. examination administered by the University of South Africa. The 
secondary school leaving examination was administered by the Joint Matricula- 
tion Board, an examining organization composed of representatives of all South 
African universities. The Council was first established in 1961 as the High 
Commission Territories Examinations Council. In 1963 the Council became 
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associated with what has now evolved into UBLS and its name in 1966 was 
changed to the University of Botswana, Lesotho and Swaziland Schools 
Examinations Council. 

The Council has an external governing board, also called "The Council", 
composed of the following representatives from each country: a representative 
of the Ministry of Education, a representati\- jnized Association 

of Secondary School Principals, and a pre _ ry school teacher. 

There are also two representatives appoiuLt ' ^ ^/ice-Chancellor of UBLS, 
one of whom serves as the Council Chairman, and a member of the University 
from each country. The future structure of the Council, as proposed in this 
plan, is discussed more fully in section 6.1.2.2. below. 

The Council presently sets and administers the J.C. examination in each 
member country. It also administers the CO. S.C. , the London G.C.E. 
examinations, and teacher certification examinations in Lesotho. (The CO. S.C. 
examinations in Botswana and Swaziland are administered by their .respective 
Ministries of Education, but this will be taken over by the Council next year 
with the establishment of National Offices in these two countries.) Curriculum 
content for the J.C. examination is now determined by national subject panels 
whose recommendations are sent to regional subject panels for final approval. 

Aspects of the present plan which relate to a local School Certificate represent 
the culmination of a series of proposals for local curriculum content determination 
which began in 1966. In that year the first proposals were set forth for the 
eventual transfer of curriculum development and examination administration 
from Cambridge to local authorities. Several factors have accounted for the 
delay between 1966 and the present plan. An overriding consideration has 
been the initial reluctance, especially in the early post-independence years, 
to surrender the assurance of "international standards" offered by an overseas 
examining body. This early reticence now appears to have been replaced by 
a sense of urgency with regard to local control of education. Other delaying 
factors have included a 1973 recommendation by CEDO consultant J. Deakin 
that the Council should not move forward with a School Certificate takeover 
at that time, and complications associated with early staff changes in the 
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reason is that educational systems have no empirical feedback mechanism to 
modify syllabusses as a function of their post-educational effects upon stu- 
dents. Quite to the contrary, syllabus content is often determined by academ- 
icians and/or public officials who have insufficient information about such 
post-educational effects of formal schooling to initiate relevant syllabus re- 
vision. 

To a'ddress this problem of the relevance of syllabus revision, the Council 
proposes to have an Assistant Registrar whose primary responsibility will be 
the evaluation of examination prograir- id the revision of syllabusses. 
Revisions will be based upon foil- ' 3s of students exiting the for- 

mal educational system. Question id interviews will be used to deter- 

mine the life-relevance of their formal educational experiences. This information 
will then be given to subject panels responsible for syllabus revision. To 
further enhance the life-relevance of the syllabusses, the private sector, as 
well as members of the educational establishment, will be represented on sub- 
ject panels. Syllabus revisions, coordinated by national and regional subject 
panels, will thus be influenced by three major sources of information: (1) the 
private sector, with respect to skills needed for initial employment and. up- 
grading, (2) the educational sector, with respect to academic background 
needed for academic activities following the various examinations, and (3) 
actual life-experiences of students who have completed their formal academic 
training . 
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CHAPTER 3 
PURPOSE 



Any undertaking of the magnitude proposed herein has res^tilts at several 
levels within society, and at multiple levels of abstraction. The more Immedlat 
and easily assessed outcomes are treated more fully In section 6,3 below. 
More broadly, however, the purpose may be viewed as three-fold as explained 
In the Immediately following paragraphs. In hypothesizing casual relation- 
ships between the proposed plan and the purposes cited beloW, it should be 
remembered that the more tempera distant these goals are ^"^^vn the plan 
' -itlatlon, the more a ,3S to attribute their acUievement to the 

plan. The goals specified, in other words, will be simultaneously addressed 
by many other factors and projects within the socio-political systems of the 
BLS countries. Although this poses particular problems for short-term evalua- 
tion efforts, such more global purposes are often the most significant for the 
nations concerned. 

3.1 HUMAN RESOURCE UTILIZATION 

The Council will enhance human resource utilization through the improve- 
ment of selection procedures following primary and secondary ^ atlon, and 
by the identification of einployment-related skills through their urate and 
appropriate certificatica^ In developing countries, where educate lal resources 
are scarce, their effecrrje allocation is extremely important for n iOmal de- 
velopment. 

3 . 2 EDUCATIONAL RESPONSIVENESS 

The proposed mechanisms for syllabus revision will assure that their 
content will be relevant for the students and society as a whole. This mechanis 
may well constitute the first formalized educational effort to me^t such needs in 
an effective manner. 

3. 3 IN STITUTjjQISa. DEVELOPMENT 

Ihe necessity of -3 crmtlnuing institutional base for social change, both 
in modem and develotiiTCrcountrles , has long been recognized. A strong 
regional educational tiH^t:iution, such as the Council, will contribute to 
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cultural relevance and low costs for education within the BLS countries. This 
will be assured by a local professional staff, well trained in modem measure- 
ment techniques, evaluation, and administrative skills. The Council will be 
developed with strong national offices, and this will constitute a federation 
open to new member countries. This structure will make expansion more likely, 
and thus increase the probability of diffusion of these innovative educational 
concepts within an acceptable traditional external examining structure. 
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CHAPTER 4 

MEASUREMENT ISSUES; EXTERNAL EXAMINATIONS 



Examinations are a powerful factor within educational systems. They are 
not intrinsically either good or bad. They may, however, be used in ways which 
result in either favorable or unfavorable educational outcomes. Major issues 
in the controversy over external examinations, briefly discussed in section 2.5 
above, are fully treated in a recent study by W.B. EUey and I.D. Livingstone 
(External Examinations and Internal Assessments , New Zealand Council for 
Educational Research, Wellington: 1972). These issues are analyzed below 
in the light of their relevance to the proposed plan. 
4 . 1 ADVANTAGES 

The following five positions are among those generally taken by those 
educators who favor external examinations. 

4.1.1 Teachers' testing expertise 

Centrally developed examinations do not require classroom teachers to 
have highly developed skills in test constractlon and student assessment. 
This issue is especially relevant in developing countries where many teachers 
have not attained the minimum qualifications for teaching, much less any 
adequate skills in student assessment. Given the inability of many teachers 
to accurately assess student performance through internal tests, expecially 
in the more remote rural areas of developing countries, external examinations 
constitute an efficient means of student assessment. Limited teacher training 
resources can then be directed more toward teaching methods and subject 
matter content, than toward techniques of test construction and student assess-- 
ment . 

4.1.2 Uniform standards 

Teachers proficient in techniques of student assessment can generally rank 
their own students quite accurately with respect to their relative achievement. 
These teachers, however, have no basis for making similar evaluations in 
comparison with the achievement of students in other classes of their school, 
or with students in other schools. External examinations overcome this 
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difficulty by having students from all schools take a common examination 
which serves as an objective standard of achievement for them all. 

4.1.3 Teachers' roles 

Within a system utilizing internal examinations, teachers must serve as 
judges of student progress. Much of the teachers' time is devoted to the 
development, administration, and grading of examinations. With external 
examinations the role of the teacher can be more of a helper than a judge. 
Teachers can work together with the students toward a common goal. If 
teachers have interpersonal difficulties with certain students, which might 
otherwise influence internal assessments of achievements, these are not 
allowed to influence external assessments. 

4.1.4 Student incentives 

External examinations provide students with long-term incentives, similar 
to actual life goals in many ways, toward which they must work over a period 
of time. These incentives are tangible, fair, and beyond the whims of individual 
teachers . 

4.1.5 Curriculum influence 

External examinations based upon pubiished,:syllabusses remove classroom 
subject matter from the control of individual teachers. Without clearly speci- 
fied educational objectives, many teachers tend to organize course content an 
the basis of their own judgments about v^hat should be taught. This produces 
variable course content and, especially in cases where there is a progression 
of courses within a single subject area (e.g., mathematics), can allow a stu- 
dent to progress to subsequent courses without the prerequisite entry skills. 

Curricula can be changed rapidly when syllabu^ses are centrally developed. 
Since teachers as well as students are aware of the subject matter upon which 
external examinations are to be based, syllabus modifications results in immediate 
changes in the direction of classroom teaching. The: subject panel approach to 
curriculum development and change, when properly- .^ministered by a central 
examining body, as3zires responsive content for syllabusses in all subjects. 
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4.2 DISADVANTAGES 

External examinations are often the focus of criticism among educators 
unfamiliar with the present operations of Commonwealth-type examining boards 
^ and their potential for rapid progress in curriculum change. Critics of the 
external examining system often confuse conceptual with technical issues, 
as clarified in the following sections. 
4.2.1 Interest, attitude, and ability 

It is frequently argued that external examinations provide no indices of 
the interests, attitudes, and abilities (aptitudes) of studen. .. Lhat iu..._..^ 
•dualities are important in student selection and career guidance. This is, of 
courss.not a problem intrinsic to external examining. It is a fairly straight- 
forward matter to assess these qualities with-extemal examinations, and re- 
quires only a policy deciaicm to do so on thspart of the responsibile authorities. 
This has, in fact, been done by the West African Examinations Council. The 
test baxtery for secondary school selection tthe Common Entrance Examination) , 
which is used to select students into secondary schools through Nigeria, Ghana, 
Sierra Leone, and The Gambia, consists of -vo achievement tests (English and 
arithmetic) and two aptitcde tests (verbal artitude and mathematical aptitude). 
4.2.2 Assessment vs. certification 

Because of their historical roles as acadercic selection devices, external 
examinations overly emphasize academic content (assessment) to the exclusion 
of skills related to post-examination activities of the majority of students 
(certification). The examinations neglect skills and aptitudes related to 
business, agricultural, industrial, technical, and clerical areas. This 
criticism, again, is related to how external assessments^re used and not to 
how they could be used. Designed into the present plan, as detailed in 
section 2.6 above, is a procedure to assure life-relevance of examination 
content, as well as the relationship of examination content to non-academic 
post-educational activities. 
4.2.3 Classroom ±>ackwash 

A conmion criticism of external examinations, especially prevelant among 
uninformed persons, is that they force teachers and students to direct their 
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classroom activities toward uniform educational objectives. Such criticism 
surely should be directed toward the content of the syllabusses, rather than 
toward the system of external examining. External examinations do require all 
teachers to focus on agreed upon educational goals. And to the extent that 
these goals are suitable, the backwash effects of external examinations rcn- 
stitute a very desirable characteristic of external examining. The issu \ich 
must be addressed with respect to backwasi. lafluenre s syllabus content and 
J0it '^ly ^iut- the concept of external examining. 

4.2.4 Single assessments 

The use of "one-shot" examinations at infrequent stages ir. a student's 
career is often cited as an undesirable characteristic of external examinations. 
This is in some ways a valid criticism. The problem of infrequent assessments 
cannot^e solved merely by having more frequent external examinations because 

of costmonsiderations. One solution to the single assessment problem is the 
use of::rontinuous assessment procedures. This permits external certification 
to be t™sed partly upon internal and partly upon external assessment. As 

mentioined earlier , the Council has already taken continuous assessment under 
advisen^ant through the feasibility study prepared by T.P. Keilthy, the Chief 
Examinations Officer of the Open University. 

4.2.5 Markers and standards 

With external examinations requiring large numbers of examiners and 
markers, especially in developing countries where there is likely to be a high 
turnover rate within these groups, there may be difficulties related to un- 
reliability of markers and inconsistency of marking standards. This has indeed 
been the case in many developing countries and, although the problem cannot 
be completely circumvented, its effects can be minimized through the following 
procedures: (1) improved training methods for markers with an emphasis on the 
employment of local educators rather than expatriates; (2) improved design of 
exammation formats to enhance marking reliability; (3) simplified marking 
schemes developed by professionally trained measurement experts; (4) better 
training for chief examiners; (5) random assignment of scripts to markers followed 
by statistical analysis of their marks to monitor standards; and (6) partial use 
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of multiple-choice tests to increase reliability and validity of tests as well 
as to broaden syllabus coverage. 

4.2.6 Local syllabusses 

The development of regional a ' /llabusses is restr / the uae 

of external examining. This is, again, a i jch .cal rather than a conceptual 
issue. The Cambridge Syndicate allows local deviations from their central 
syllabusses, and will prepare examinations on any such approved syllabus. 
The UBLS/SEC allows similar options at the J.C. level. Such deviations, 
however, are costly and should be allowed only where there is clear justifica- 
tion for the additional expenses. 

4.2.7 Success prediction 

External examinations often predict academic success only moderately 
well in subsequent education and training, or in non-academic post-examination 
pursuits. This is true of many external examinations in their present state of 
development. This situation, however, can be improved with better examination 
development procedures as has been done in the United States. At the post- 
secondary level, prediction can be increased, especially for academic pursuits, 
by the combination of external examination results with secondary school inter- 
nal assessments. This is a technical problem, and can be addressed by a 
psychometrically well-qualified staff. 

4.2.8 Results delay 

The delay of results associated with large external examinations can 
restrict educational planning. This is true of many external examinations as 
presently conducted. The delay of results can be minimized through the use of 
improved examination formats designed for faster marking, and a computer 
compatible marking and reporting system. The use of machine scored multiple- 
. choice tests, even for a few subject areas, c a- greatly reduce the time taken 
to process examinations, as well as marking costs. 

4.2.9 Student feedback 

External examination systems are often criticized because they deprive 
. students and teachers of informative feedback about the relative strengths and 
weaknesses of instructional programs with respect to individual students, 
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schools, and school districts. This is only an issue because such feedback 
is not generally given, not because it cannot be given. The West African 
Examinations -Council, for example, has in the past prepared feedback reports 
based upon analyses of the multiple-choice tests administered at O-Levels. 
This can be a costly procedure, although costs are considerably lower with 
machine-scored multiple-choice tests, where responses to Individual test 
items can be read directly into the computer memory as a part of the original 
scoring procedure- 
4#2*10 Standarcxs over time 

Another measurement issua, related to external examinations, concerns 
the maintenance of standards from one year to the next within a single subject 
area, and the equivalence of grades between subjects both within a single 
year and from one year to the next. This problem is generally handled by the 
Commonwealth examining boards through the dependence on expert judgment 
about the relative difficulty of examinations from one year to the next, and by 
assuming that thera is only insignificant year-to-year variation in student 
achievement when the population of examinees is relatively large. While 
this procedure provides a partial hedge against wide fluctuations in standards, 
it is not easily defensible on the grounds of sound measurement theory. This 
problem has been addressed by psychometric experts at Educational Testing 
Service in the United States and it is proposed that some of their procedures 
be applied to examinations in the BLS countries. These procedures require 
neither the use of multiple-choice tests nor excessively large and stable stu- 
dent populations from one year to the next. 
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CHAPTER 5 
PROGRAM STANDARDS 



The following program standards, in the areas of technical excellence 
and curriculum reform, are suggested as design and development criteria 
against which the plan and its implementation can be evaluated. 
5 • 1 TECHNICAL EXCELLENCE 

5.1.1 Examinations 

The examinations must meet professional criteria with respect to their 
reliability and validity. 

5.1.2 Standards 

There must be parity of standards from year to year within single subject 
areas, and between subject areas within a single year. 

5.1.3 System compatibility 

All activities of the Council must be coordinated with other related educa- 
tional programs. This includes projects such as the primary school curriculum 
reform program in Swaziland and the Regional Testing Centre in all three coun- 
tries. 

5.1.4 Utility 

The program must be relevant, timely, and flexible for it to be credible. 
It must be accepted and respected by government, educational institutions, 
teachers, parents, pupils, the private sector, and the community at large. 

5.1.5 Comprehensiveness 

The program must address the total development needs of the member 
countries, and not merely the academic requirements of higher-order educa- 
tional institutions. 
5.2 CURRICUL.UM REFORM 

The Council's growth should avoid a simple replication of the sometimes 
cumbersome organizational problems of some Commonwealth examining bodies. 
It is suggested that sound technical measurement and planning expertise be 
fully utilized from the beginning of the plan and, most importantly, that the 
plan be implemented along with programs of primary and secondary curriculum 
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refom. This curriculum reform should reflect consultation with educmors, 
private sector employers, and government; so that syllabusses reflect essential 
post-educational knowledge and skills to the greatest extent possible. 
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CHAPTER 6 
APPROACH 



This section describes the Plan of Action for the proposed ten-year 
development period, followed by the Inputs and resultant Outcomes anticipated 
from donor assistance. 
6 .1 PLAN OF ACTION 

This plan utilizes an existing institutional framework, minimal advisory 
assistance for rapid localization, and a proven sequence of emphasis in pro- 
gram development. Because of the interest and enthusiasm of the involved 
countries for development activity in this area, there will be immediate impact 
upon the associated educational systems if the planned inputs are not delayed. 
Timeliness, therefore, is an essential factor in any technical assistance re- 
lated to implementation of this plan. 
6.1.1 Institutional development 

Technical assistance agencies have long been aware of the powerful in- 
fluence of an institutional framework for the initiation, promulgation, and 
continuation of socially innovative concepts. The proposed plan will utilize 
an institutional framework, as described below, to implement the CounciPs 
innovations in examinations and curriculum change. 

Existing Institution. The development plan is based upon the expan- 
sion and improvement of en existing institution. This approach avoids initial 
development problems usually associated with institutional establishment and 
public acceptance, thus resulting in considerable savings in time and resources. 
6*1*1.2 Strong National Offices , The proposed structure provides for strong 
National Offices, with common services provided by a Headquarters Office. 
The presence of a strong National Office in each member country, staffed by 
trained local professionals, will assure the relevance of examinations to local 
educational needs. All international curriculum panels will have representatives 
from national curriculum panels, thus removing the possibility of an interna- 
tional curriculum body becoming insensitive to local needs. 

The proposed structure for the Council is shown in Figure 1 ( Governing 
Structure) . The Examinations Council itself, whose membership is described 
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above in section 2.4. , meets annually to review Coimcil activities and make 
major policy decisions. The Standing Committee meets on an ad hoc basis to 
handle the more routine aspects of the Council's operations. Day-to-day 
Council activities are handled by the Registrar, Reporting directly to the 
Registrar are four Deputy Registrars, one for each of the National Offices and 
one for the Headquarters Office . 

Figure 2 ( Headquarters Office) shows a Deputy Registrar, who assists the 
Registrar with supervision of the three Assistant Registrars, and serves as 
Acting Registrar in the Registrar's absence. (The other three Deputy Registrars 
may also be assigned this responsibility from time to time). There are 3 Assistant 
Registrars, one each for Examinations Program Evaluation, Systems and Data Pro- 
cessing, and Program Coordination. The structure for each National Office is 
indicated in Figure 3 (National Offices ) . Each has an Assistant Registrar re- 
sponsible for Examinations Administration, and for Training, respectively. 

The posts shown in Figures 1 and 2 are those planned for 1985. Some may 
initially be filled at lower ranks than those shown in the Figures, with promo- 
tions expected as the Council's responsibilities increase over the years. 

6.1.1.3 Expansion . The decentralized structure facilitates expansion of the 
Council. Additional National Offices can easily be added with minimum expan- 
sion of the Headquarters staff. New member countries can be guaranteed that 
any changes in their educational systems will remain under their ultimate con- 
trol, because the impact of the Council on national educational systems will 
be moderated by the presence of these National Offices. 

6.1.1.4 Capital c onstruction . Proposed capital construction requires office 
accomodations for all Council operations. Construction details and associated 
costs are presented in section 6.2.4. below. 

6.1.2 Training 

The approach to training wQl place local professionals in line positions as 
early as possible. Technical Advisors will hold such positions when absolutely 
necessary, but will depart as soon as returned counterparts have been trained. 
As soon as possible, returned counterparts will be assigned to line positions, 
and any advisor previously occupying those positions will remain in an advisory 
role for a minimum overlap. 
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To minimize the training needed for the plan, and to facilitate early 
localization, trained counterparts from the Regional Testing Centre should be 
transferred to the Council wherever possible. (This should not seriously 
interfere with functions of the Regional Testing Centre, as many of its services 
can be assumed by the Council.) 

Training will consist of formal academic courses, short-courses with spe- 
cial focus, and on-the-job training. All training will prepare staff for Council 
responsibilities rather than have a traditional academic orientation. Univer- 
sities will be asked to prepare special course sequences specifically designed 
for the. Council's needs. Seminars and special workshops will be conducted, 
as required, in cooperation with institutions such as the Cambridge Syndicate, 
the West African Examinations Council, the Malawi Certificate of Education 
Examination Board, the American Institutes for Research, and Educational 
Testing Service. 

Staff Development Schedules for the Headquarters Office and the three 
National Offices are shown in Tables 1 through 4 . Table entries indicate the 
localization schedules for each of the 63 staff positions. Some will be 
localized from the first year of operation. A few are first to be occupied by • 
an advisor while a counterpart is being trained. All posts will be filled by 
local professionals by the fourth year, with only three advisors present in 
advisory roles during the fifth and sixth years, two during the seventh and 
eighth, and none during the ninth and tenth. 

The formal academic training for the senior staff, necessary for a timely 
implementation of the proposed plan, is summarized in Table 5 (Participant 
Training Schedule ). This requires 8 staff trained at the Masters level and 
2 at the Doctoral. An additional 3 Masters and 2 Doctorates are scheduled 
for wastage and dropouts, as well as to hedge against possible losses to 
other programs. This additional training also allows for the possible expan- 
sion of the Council's programs into areas not presently anticipated, such as 
guidance and aptitude testing. 

Estimated advisory services required to implement the -plan are summarized 
in Table 6 (Technical Advisory Schedule ) . Both Tables 5 and 6 are coordinated 
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with the Staff Development Schedules shown above in Tables 1 through 4 . Techni- 
cal specialties for the required advisors are indicated in Table 6. Short-term 
consultant services are also required for the plan, and are shown in Table 6. 
6.K3 Program development 

The following sections describe three basic program aspects addressed 
by the plan. 

6.1.3.1 Examination Administration , The entire examinations administration proce- 
dure will be reviewed and revised by management and psychometric experts. 

The revision will streamline the entire process to reduce costs and speed the 
delivery of results. The training program will emphasize administrative training 
as well as technical expertise. 

6.1.3.2 Examination procedures and analysis . Formats of both the essay and 
multiple-choice examinations will be revised to make marking more reliable 
and faster. A computer systems analyst trained in educational data processing 
will devise a system specifically tailored to the Council's needs. The Council 
will have its own computer with data capture units in each National Office. 
The country units will enable each country's examinations to be scored locally, 
with the scores then being sent to the Headquarters Office on magnetic casette 
tapes for central processing. 

6.1.3.3 Examinations programs. The initial focus of the plan is the J.C. 
This is necessary as there have been some difficulties with this examination' 
in the past, and the Council should establish public credibility for this program 
before expanding into other areas. This should be done by the 1976 examination 
year. The second focus will be the primary school examinations, and responsi- 
bility for processing results of these examinations should be handed over by 
about 1978. Takeover of the O-Levels is scheduled to begin with the 1981 
examinations, and .phase over a five-year period. During this takeover period 
the School Certificate will be awarded on a joint basis with an overseas examin- 
ing board, most likely the Cambridge Syndicate if satisfactory arrangements can 
be made, with the Council assuming full responsibility for the S.C. by 1985. 
During the ten-year period responsibility will be assumed for other examination 
programs on an as-needed basis. Such examinations will probably include 

a heavy emphasis on technical and commercial examinations. 
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6.1.4 Project Implications 

The project results have the following Implications for education within 
the member countries. 

6.1.4.1 Standards . There will be centrally maintained standards of achieve- 
ment, with parity from year to year. Scaling and moderation techxilc . =s will 
be introduced to maini-.^.r ':adards, an r . -^rl. ::ous ass^essment techiuiniues 
will gi'fcually be i^trodi^^tsi permit scho::?! rr^udes to be taken into oorisldera- 
tion in the award cf ec-riiidtiirrrral certificates. 

6.1-4.2 Curriculum reirrrsi , The system for syllabus development d cfhange 
will facilitate the introc ct,on of new. and updated course content.. "Ae educs- 
tional system will thus -ible to better deliver skills essential tcy:^ ocial end 
political development, cxso-rdinated with inditrzrual considerations. Evaluative 
feedback, as described above in section 2.6^.. will assure the life -relevance 
of educational programs. 

6.1.4.3 System evaluation . In addition to reliable information about individual 
achievement, the proposed system will provide information about system effec- 
tiveness on the school, school district, and national levels. This will be done 
at only moderate additional cost if programmed into the original development of 
the data processing and retrieval system. 

6.1.4.4 Objective tests . Early consideration will be given to the use of 
multiple-choice machine-scored tests wherever feasible. Such tests can pro- 
vide more extensive syllabus coverage than essay examinations which take the 
same administration time, thus permitting more comprehensive feedback to 
individuals and schools about program effectiveness. Objective tests also 
reduce the problem of examiner training. In addition, they can also be graded 
more rapidly and reliably than essay examinations. 

6.2 INPUTS 

The following inputs are those required from external donors for a timely 
and effective implementation of the development plan. Without these inputs 
the ten-year period would be extended and/or the local costs would have to be 
revised upward. (Local costs are presented in full in section 7). 
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6.2.1 AciTlsory servidfes 

To Imixienient the plan prO;penr'"vrould requnxe 45 man-years of advisory 
services, 3 of which wculd i-^aocnposed of shonz-term consultants, and 42 of 
residential advisors. Rojrhjs £\nd sntrrHdluLes of these advisors if^: summarized 
in Table 6 (Technical Adviso: d^-^^ ^xl^) . 

6.2.2 Training 

External academic trainircg ^as^o:riaied with the plan consist! of 35 man- 
years, and is summarized by specriaUv level, and timing In Table 5 ( Partici- 
pant Training Schedule) . Th^ ^zcvt^-^^-Jccses amd cm-the-job training will be 
planned and executed by the::f?f--siite :* technical advTilsors and Assistant Registrars 
responsible for training. 

6.2.3 Equipment 

The equipment to be fundsr : c - CTior Is Indicated in Table 7 (Recommended 
Data Processing Equipment) , rh' cost is R91,400, and provides a central 

data processing capability at t riniicnpiarters Office, with dat=i capture and 
editing capability at each Nati ra^. :±±Lce. The suggested mln coirijputer equip- 
ment is based on a survey of se computer companies with offices in the 
South African area. The choice Tiade on the basis of ease of operation, 
cost, service arrangements, CHrs±I:-y, expandability, and ruggedness . Prior to 
recommending the Wangequipmsii^, experts from Swaziland's Ministry of 
Finance computer Installation perennially inspected equipment of the Wang, 
Datapoint, and Interdata companiHia, Sruipment from several other companies 
was rejected without the necesH±iJ^c:;„2Ci on-site inspection. 

6.2.4 Capital requirements 

Capital requirements for thirst S^xronal Offices, one Headquarters Office, 
and seven vehicles @ R7,000, are summarized In Table 8 (Capital Requirements ) . 
The total cost Is R211,000. Table 8 also indicates the square meter cost basis 
for the buildings. 
6.3 OUTCOMES 

The immediate and more easily verifiable outcomes are summarized below. 
These will contribute to some extent no the more global and temporally distant 
purposes described in section : above. 
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6. 3.1 Institutional 

At the compltBtion of the plan there will be an institutionalized loc^ 
capability for educational certification examinations and curriculum reibnn with- 
in the BLS countrie^s. 

6.3.2 Functional 

The following three functions will he served by the Council. 

6.3.2.1 Certification . The Council will issue certificates of educatic:t=::. 
achievement reflecting international standards with parity from year to ^sht* 

6.3.2.2 Selection. . Examinations administered by the Council will ser^"^ a.s 
selection criteria for further education as well as for selection into traziniing 
programs within the private sector. If desired, tests of aptitude and/zir 
interest could be included in the major examinations. Scores on these rasits 
could be disregarded with respect to certification, but incorporated intc 
selection decisions and/or careers guidance programs. By having the aptitude 
and/or interest tests administered simultaneously with the major certification 
programs, the incremental costs of this additional information would be 
greatly reduced as compared to costs of a separate program. 

6.3.2.3 Curriculum reform . As treated more fully above, the suggested sys- 
tem for curriculum change can make educational content more responsive to 
social, political, and individual needs. This is an important issue because, 
within an educational system based upon external examinations, syllabus 
change is the only path to effective curriculum change. 
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Estimated =>iDer-.zitures and income, wizrr. sumn-.^T the two, are 
presented in the rDilmwing sscttons. AIL fig:=r=iS are :v. Soarh African Rand 
(Rl.OO = $1.42). 

7.1 EXPENDrTU~33 

Estimated exper^xlum- lare dividsd into 10 iiead3 and ^presented in Tables i 
(Expenditure Estimats^g for asadauarters Office) and .!§ (EsiEnditiire Esttmen^ icr 
National Offices). Eases for the estimates under eaciii hesd are in working is- 
pers which have beer, given to the Registrar. 

7.2 INCOME 

Estimates of income, based on candidate fess from examinations, are given 
in Table 11 (Candidate and Examination Fees Projections) . Details of the candi- 
date numbers and fee structures, which form the basis for these projections ^ 
in working papers which have bean given to the Registrar. Income not incluried 
in this table Is R112,&:D4 for data processing equipment to be purchased in 1376 
and R211,0 00 for capital cons-ruction planned for 1977.. These two amounts ars 
iincluded in rhe following summary of expenditure and income. 

7 . 3 SoIMMARY 

The financial picture for the Council over the ten-year development period 
is given in Table 12 ( Income and Expenditure Summary, ). This summary shows 
a deficit oi R212,140 for 1976 which scal-s down to a detiicit of only Rll,049 for 
1980- Given the assumptions cmderlying these financial projections, aU sub- 
sequent years show a suirplus, ijeglnning m 1981, with a (Simulative surplus of 
R475,337 over years iggl-igHS . Adjustments for inflaticrr have been made neither 
in expenditures nor in income. It Is assayed that any imflatlonary increase in 
expenses will be offset by similar an:± aquivcii:^t increasves in Income. The 
gist of Table 12, then, is thax the CoTsncil wiLll become a financiaEly viable 
institution within 5 years operation, given r-ne donor ^sistance estimatea 
in the present plan. Profit from the sixth yesr oiiward could be used eiteter 
to reduce fees, to Initiate new programs, or to keep fees stable even under 
inflationary conditions of expenditures. 
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